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The amount of correlation attainable between the components of a quantum system is constrained 
if the system is closed. We provide some examples, largely from the field of quantum thermody- 
namics, where knowing the maximal possible variation in correlations is useful. The optimization 
problem it raises requires us to search for the maximally and minimally correlated states on a uni- 
tary orbit, with and without energy conservation. This is fully solvable for the smallest system of 
two qubits. For larger systems, the problem is reduced to a manageable, classical optimization. 
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The idealized notion of a closed system is central to 
both classical and quantum mechanics, across scales from 
the microscopic to the universe itself. Here, we concern 
ourselves with the quantum mechanical version of a fun- 
damental question: In the interactions between the con- 
stituent components of a closed system, to what extent 
does the closure of the system constrain the correlations 
attainable? 

We focus on the simplest case, where we divide the 
closed system into two parts and the correlations be- 
tween these are quantified by the mutual information. 
For a given bipartite state of the system we therefore 
seek the two extremal (minimally and maximally) corre- 
lated states under all evolution that does not change the 
total entropy. We will also consider the case of evolution 
that obeys the additional restriction of energy conserva- 
tion, either in a weak sense (the expected energy stays 
constant) or a strong sense (the interaction commutes 
with the free Hamiltonians of the two subsystems). 

We find that the answer to these problems, particularly 
for the case of the minimal attainable correlation, has 
a surprisingly rich mathematical structure. Because of 
the foundational nature of this result it can be applied 
to a range of problems. Before turning to our technical 
results, we present in some detail three such examples 
from the field of quantum thermodynamics. 

Example 1: Environmentally friendly work extraction 
from a Szilard Engine. Our first example concerns a Szi- 
lard engine immersed in a thermal bath at temperature 
T using correlated particles from which to extract work. 
The engine admits individual subsystems, one at a time, 
to "burn as fuel" . We consider the case of two quantum 
subsystems, described by a bipartite mixed state p. For 
such fuel reserves, we can extract [1] from each subsys- 
tem at most an amount of work = fcT(log c?^ — S'(/5^)) 
where is the dimension of subsystem n g {A, B}, p^j is 
its state, and >5'(p^) = — tr(p^logp^) is its von Neumann 
entropy. The goal is to increase the total work extracted 
from the pair of systems: 

W = Wa + Wb = kT{\ogdAdB ~ S{pa) - S{pb)). 

To do so, before the systems are fed into the engine they 
are sent into a refinery whose purpose is to "purify" pA 
and pb so as to reduce S{pa) + S{pb)- More accurately. 



the refinery tries to localize existing purity in the compos- 
ite fuel state. Such a purification scheme has been consid- 
ered before under the restriction of local operations and 
classical communication (LOCC) processes [J how- 
ever, here we work in a broader context and permit a 
global operation on the composite fuel state p, but cru- 
cially we impose the restriction that the refining process, 
which takes p to p' , must be "environmentally friendly" 
in the sense that all measures of purity, such as the von 
Neumann entropy or tr[/9^], remain constant |19j . As a 
result, we are forced into taking the refining process to 
be a global unitary operation on the full reserve of fuel. 

The extra mechanical work obtained through the re- 
fining process is W^'^tra ^ -kT{ASA + ASb) = -kTAI 
where = S{p'^) - Sip^), AI = lip') - I{p), and we 
have introduced the quantum mutual information (QMI) 
I{p) = S{pa) + S{pb) - S{p) > 0, which is the nat- 
ural measure of correlations. If A and B are initially 
uncorrelated, the QMI is at its minimum and cannot be 
reduced; W°^^'^^ — 0. However, if correlations are ini- 
tially present in p, it is possible to obtain |T4^™*'''*| > 0: 
a natural challenge is to find the maximum | VF'^'^*'''^ | for 
a given initial state fuel reserve p, in other words, to 
determine the largest attainable |A/| under the environ- 
mentally friendly constraint. Generically, it is impossible 
to fully decorrelate the state, and the optimal refinement 
process reduces to the broader problem under considera- 
tion in this article. 

Example 2: Anomalous heat flow in the presence of 
correlations. It is known for two subsystems of a closed 
system, each initially in thermal states, that the tradi- 
tional thermodynamic fiow of heat from hot to cold can 
be distorted by the presence of correlations O H]. In- 
deed, with sufficiently strong correlations, a substantial 
amount of heat can be made to flow anomalously from 
the colder to the hotter system. What are the limita- 
tions on this process? Again, let p be the initial joint 
state of the two systems, p E {A,B}. By assumption, 
each subsystem is initially in a thermal (Gibbs) state 
Pp. — P^^ — e^^^'-^^'/Z^ at temperature — kT^, 

where — tr(e~^^'/"^f ), is the partition function. The 
subsystems interact, either by switching on a known con- 
trolled interaction for some finite time or by a scattering 
process, and the composite state p evolves to a final state 
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p', which has local states p^, p'^. 

The free energy functional F}ij-\p\ := iv{pH) — kTS{p) 
is obtained from the relative entropy function with re- 
spect to the Gibbs state and is defined over the full 
state space. It is minimized by the thermal state 
e^'^^/tr(e^^^), — kT, and its value coincides with 
the usual thermodynamic free energy. Thus each subsys- 
tem satisfies the inequality Fff^,T^[p^] - FH^,T^[Pf,] > 
for any state p'^ (originating from the positivity of the 
relative entropy) which when added together yield 

I3aQa+PbQb>ASa + ASb, (1) 

where = tr(pj^i?^) — tr(p^7?^) is the heat [20] into 
system p. Note that this inequality only demands that an 
initial temperature be defined, and no further restrictions 
on p'^ are needed at this stage. Under the closed system 
constraint of constant total entropy and constant energy, 
Qa -I- Qb = 0, we can write ([T]) as 

This inequality provides directionality for any energy 
conserving process. It relies on local initial properties 
but also depends on non-local correlations. Any initial 
correlations, up to the constraint of thermal marginals, 
are permitted and the bound is independent of any as- 
sumptions on interaction strength, in contrast to several 
previous considerations of the thermodynamics of open 
quantum systems where weak coupling between the sys- 
tem and the bath is required (5^-^. We are interested 
in the evolution of a closed system which in itself dis- 
plays thermodynamic behaviour. In standard thermo- 
dynamics it is assumed that the interacting systems are 
initially uncorrelated, rendering the entropy as additive: 
p = Pa® Pb and thus I{p) = 0. As the interaction can- 
not decorrelate A and B any further I{p') > I{p) and 
it follows that the left hand side of equation [2] must be 
positive. This means that when Ta < 7s it must be 
the case that Qa > 0, and heat flows in the standard 
manner, from hot to cold. 

In general, however, systems A and B could initially 
possess correlations [2T], in which case the interaction 
could lower the QMI. If A/ < then there is no longer 
an absolute restriction on the direction of heat flow and 
for a suitably chosen interaction we will deterministically 
observe heat being transferred from the colder to the hot- 
ter body. We call this anomalous heat flow (AHF). Even 
though the local entropies have decreased and negative 
heat flow has occurred, after the local measurement of 
the individual energies the system is left uncorrelated 
and thus one cannot cause heat to flow from cold to hot 
in a cyclic process, thus saving the second law. In this 
sense correlations are a resource. 

To observe a large AHF, the initial state of the sys- 
tem would have to be very correlated, possibly entan- 
gled. Indeed, the AHF constitutes a discriminating fea- 
ture between quantum and classical thermodynamics. 



and may be used as an operational indicator of entan- 
glement [4] that does not require knowledge of the joint 
initial state of the two systems! This is easily seen, 
since the QMI over separable states is bounded from 
above by log(min{(i^, ds}), while for the full quantum 
state space the bound is twice this. Therefore when 
A/ > log(min{(iyi, c?b}) the initial state p must be non- 
separable, and in turn, any transfer of heat from the 
colder to the hotter body of an amount greater than 
iQg(min{dA^dB}) jjjjj(,j^|;gg j^j^g pj-escncc of entanglement [1] . 

Keeping in mind the additional constraint of equal en- 
ergies for p and p' included in this example, the quantity 
of AHF possible in a closed system is bounded by the 
largest A/ that can be obtained reversibly. Once again, 
the determination of such a fundamental limitation re- 
duces to our general problem. 

Example 3: Partovi/Peres collision model of equilibra- 
tion. In Ref. [8] Partovi proposed a collision model of 
equilibration, later simplified by Peres [9]. Two ingredi- 
ents are required in the collision process: firstly an in- 
crease in the local entropies, which is achieved by inter- 
acting two initially uncorrelated quantum systems via a 
(strongly) energy conserving unitary, and secondly irre- 
versibility, causing a growth of the total entropy of the 
system. In the model the latter is enforced by assuming 
that the two systems decorrelate after interacting. One 
full collision can be written as p = pA ® Pb ^ p' — 
UpW ^ p'a®p's, with Sip'^) + Sip's) > SipA) + SipB). 
This process is reiterated, and it can be shown the sys- 
tems reach a stationary state of equal temperature. 

The second requirement of complete decorrelation to 
a product state is very stringent - given that physical 
systems typically dephase (i.e. off diagonal "coherences" 
of the density matrix decay) much more rapidly than they 
completely decorrelate. A natural question therefore is 
whether the systems can retain some minimal amount 
of correlation and still reach equilibrium. Part of the 
solution to examples 1 and 2 is finding the state which 
has the minimum QMI on a unitary orbit: when the two 
interacting particles are qubits, we can use this result to 
show that, after the unitary part of the collision, if the 
qubits dephase to this minimally correlated state (which 
is not a product state) then equilibration is still achieved 

m- 

Overview of the general solution: Given an dAdB- 
dimensional bipartite state p with spectrum A — {Xi}; 
our goal is to find pmin (pmax) deflned, modulo local uni- 
tary transformations, as the state for which / is minimal 
(maximal) over the unitary orbit [llj . O — {t : t ~ 
UpU^}, for all unitaries U of dimension A^. For simplic- 
ity we do not demand energy conservation for now but 
revisit it later when we consider a two qubit system. 

Finding the maximally correlated state is hard clas- 
sically ^lOJ but fairly straight forward over the space of 
quantum states. We can always find a unitary that trans- 
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forms a state to 

N' 

Pmax = 5]A,|$,)($,|, (3) 

1=1 

where {|<&i)} is any generalized Bell state basis [H] with 
N' — {mm{dA,dB})^ , obtained from the Schmidt de- 
composition. Since tr^(|$i)(<I>i|) cx I_b for all i we de- 
duce that also tiAiPmax) Ib and in turn /(pmax) — 
2 log(min{(i^, ds}) — 7?(A). This is the maximum attain- 
able value of the QMI over all state space, with a reduc- 
tion by the amount H{A} = — J2i Ai log A^, the Shannon 
entropy, because of the restriction to a unitary orbit. 

Finding the minimally correlated state is considerably 
harder: because the total spectrum of the state is fixed, 
given an initial state p, there does not always exist a 
unitary transformation that can decorrelate its subsys- 
tems. Hence /(pmin) > in general and, unlike Pmaxj the 
minimum sum of the local entropies depends on A. The 
challenge is to optimize over the set of reduced states 
compatible with a composite system having a fixed spec- 
trum A. Finding the set of allowed such reduced states is 
the highly nontrivial "quantum marginal problem" |13l - 
[15]. 

The initial difficulty is that the optimization problem 
is not convex. There does not even appear to be a simple 
argument that the minimally correlated state should be 
separable, although intuitively it seems reasonable that 
this should be the case. 

In fact we are able to prove something stronger: the 
minimum of the quantum mutual information I{p) over 
the unitary orbit is attained for a classically correlated 
state 

Pmin = ^ Ajfe I e, ) (e, I ® I /fe) (/fcl , (4) 
j.k 

where Xjk, j = l,..,dA,k = l.-ds is a reindexing of A^ 
and {|ej)}, {|/fc)} are orthonormal basis states for sys- 
tems A and B. That is, the minimum of the QMI over 
the unitary orbit equals H{J2j ^{^jk))+H{J2k n(Ajfc)) — 
H{A), where the first two terms are the Shannon en- 
tropies for the marginal of some permutation (11) of the 
eigenvalues Xjk- 

To prove this, we consider the function G[(ta,cb] ~ 
S[aA] + S[(Tb] defined over the convex hull C of the 
unitary orbit O of p. The states in C take the form 
a = Y^iPiUipUj, with Y.Pi = li Pi > and ctajCTb 
are the reduced states of a. We then look for the minima 
of this function G. If these happen to occur on the uni- 
tary orbit, where S{p) in constant, then it will also give 
us the minima of / over O. 

Writing the eigenvalues as components of vectors, v = 
spec((T) and A = spec(p), it can be shown that the re- 
duced states of any a (which include the unitary orbit 
states) have eigenvalues that are marginals of a probabil- 
ity distribution obeying the majorization relation v ^ \ 
[TS] . Note that all u satisfying this relation form a convex 



set 'P(A). G can be shown to be concave on the set 'P(A), 
and so its minima occur at the extremal points. These 
extrema are permutations of the components of A, whose 
corresponding states lie on the unitary orbit, and so the 
minimum QMI occurs at a permutation of the {A^} 22]. 

However, knowing that the state is classical is not 
the full solution to the problem. Consider a state with 
spec(p) = (1/2, 1/2,0,0) - the two classical states of the 
form ^ (|00)(00|-|-|ll)(ll|)/2 and (|00)(00|-K|01)(01|)/2 
have the correct spectrum but the former is correlated 
while the latter is not. So the QMI depends on the or- 
dering of the eigenvalues in pmin- 

There are TV! different permutations of Xi to consider, 
however it is possible |10] to reduce this number down 
to an irreducible set of Young Tableaux TB' in which the 
minimally correlated state will be found. For the simplest 
case of dyi = (is = 2 the set has a unique element, which 
can be compactly represented 



Here the eigenvalues A^ are in non-increasing order, and 
row j column k corresponds to the re-indexing element 
Xjk of Eq. Q above. For = 2,(iB = 3 the full set of 
permutations has (d^ds)! — 720 elements, however our 
analysis [THI reduces this to just 5 tableaux: 
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For the case of two qutrits there are 21 tableaux to con- 
sider, for two 4-dimensional systems the irreducible set 
has approximately 12000 elements. Clearly it would be 
desirable to have an efficient algorithmic procedure to 
identify the element on the irreducible set on which the 
minimum is attained, but it is currently not clear if one 
exists. 

The primitive case of two qubits: As an illustrative ex- 
ample we consider two qubits in which case the preceding 
discussion shows that the minimal QMI on a unitary or- 
bit has a value of 

/(Pmin) = i^(Al + A2) + i/(Ai + A3) - i/(A), 

where Ai > A2 > A3 > A4 and we have used the notation 
for the binary Shannon entropy H{x) = —a; log a; — (1 — 
x) log(l — x) in the first two terms. Therefore the maxi- 
mum that the QMI can change by for a two qubit system 
undergoing a global unitary transformation is 

^^max ^ 2 - i/(Ai + A2) - i/(Ai + A3). (6) 

Considerable insight into this case can be gained by 
doing the optimization more explicitly. This is possible 
because the quantum marginal problem for a composite 
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FIG. 1: Regions TZ (shaded) of allowed Aa (jy-axis), As 
(a;-axis) when the joint state of two qubits, with spectrum 
A = {Ai}f=i, has various ranks: A — (a) {1,0,0,0}, (b) 
{0.8,0.2,0,0}, (c) {0.5,0.5,0,0}, (d) {0.6,0.3,0.1,0}. AA,Ai3 G 
[0, |]. For each spectrum, the hollow circles correspond to 
Pmin, the large filled ones to Pmax. In (d), a state with energy 
E defines the set TZe of states which could also have energy E. 
It is bounded from "above" by the solid-and-dotted line, on 
which the state itself is situated. The maximally correlated 
state in TZe is at q. 

system of two qubits has been solved [11] and the resuhs 
are readily applied to our situation. Examining this also 
allows us to include the constant energy constraint. 

Let us denote the two eigenvalues of the reduced state 
as A^, 1 — where A^ < |, G {A^B}. There is 
a set of inequalities that constrain the spectra of these 
marginals, given A, to a set TZ [23] • Figure [l] depicts the 
shape of the set TZ (shaded) that A^ , As occupy and gives 
some representative examples of how it varies according 
to the rank of p. 

Two qubit correlations with energy conservation: Ex- 
ample 2 above sought the maximal change in the QMI for 
a bipartite system in a state p undergoing unitary evolu- 
tion to a new state p' and constrained to energy conser- 
vation ti{pH) = tT{p'H) :— E, where H ~ Ha + Hb is 
the sum of the original local Hamiltonians. The reduced 
states of p' are allowed to be non-diagonal in Ha , Hb ■ 
This divides the set TZ of allowed reduced states into 
two regions: ones that could have energy forming the 



set TZe Q TZ, and ones that could not. TZe defines an 
"energy-conserving region" . For simplicity, let us pick 
Ha — Hb — so the energy spacing of Ha equals 

that of Hb- The region TZe is shown in figure [l] (d). 
It is shown in Ref. [10 that the maximal variation of 
correlations for a two qubit state undergoing an energy 
conserving unitary transformation is found to be 

A/r" = 2H (^1^ - i/(Ai + A2) - H{X, + A3), 

where the maximally and minimally correlated states in 
TZ E are also shown in figure [l] 

An interesting observation is that the point q in the 
figure does not uniquely define a joint state (even up to 
local unitaries). It can be the case that a strong energy 
conserving unitary acting on one state at q transform it 
only along the solid portion of the line however it evolves 
another along the full solid-and-dotted line. This is be- 
cause these two states have different types of correlation 
even though they have the same QMI. The details for 
this appear in Ref. [10]. In any case the set of states 
reached m TZe is restricted to the line for strong energy 
conserving unitary evolutions. These states have min- 
imal variance for energy measurements. Weak energy 
conserving unitaries can transform the initial state to all 
other points in TZe, which involve intrinsically quantum 
fiuctuations via superpositions. 

Conclusions: In this Letter, we have analysed the ab- 
stract problem of how correlations vary along unitary 
orbits for isolated quantum systems, an intricate mathe- 
matical task that reveals a complex relationship between 
the mutual information and the ordering of a bipartite 
probability distribution. The results of this find applica- 
tion in different thermodynamic scenarios such as equi- 
libration, heat exchange and localisation of free energy. 
Our work can be extended to understanding the correla- 
tion structure of more complicated processes, such as a 
quantum channel consisting of k unitaries each applied 
with some probability pk to the bipartite state. It would 
also be of interest to explore connections between our 
work and the recent papers [ITl [18] on the resource the- 
ory of quantum thermodynamics. 

We wish to acknowledge R. Spekkens and J. Anders 
for their useful comments. This work was supported by 
EPSRC. 



[1] J. Oppenheim, M. Horodecki, P. Horodecki, and 
R. Horodecki, Phys. Rev. Lett. 89, 180402 (2002). 

[2] R. Alicki, M. Horodecki, P. Horodecki, and R. Horodecki, 
Open Sys. & Information Dyn. 11, 205 (2004). 

[3] M. H. Partovi, Phys. Rev. E 77, 021110 (2008). 

[4] D. Jennings and T. Rudolph, Phys. Rev. E 81, 061130 
(2010). 

[5] T. M. Nieuwenhuizen, J. Mod. Optics 50, 2433 (2003). 
[6] A. E. AUahverdyan and T. M. Nieuwenhuizen, J. Phys. 



A: Math. Gen. 36, 875 (2003). 
[7] A. E. AUahverdyan, R. Balian, and T. M. Nieuwenhuizen, 

J. Mod. Optics 51, 2703 (2004). 
[8] M. H. Partovi, Phys. Lett. A 137, 440 (1989). 
[9] A. Peres, Quantum Theory: Concepts and Methods 
(Springer, 1995). 
[10] S. Jevtic, D. Jennings, and T. Rudolph, arXiv:1112.3372 

[quant-ph] (2011). 
[11] K. Modi, arXiv:0902.0735 [quant-ph] (2009). 



5 



[12] D. Sych and G. Lcuchs, New J. Phys. 11, 013006 (2009). 

[13] A. Klyachko, arXiv:0409113 [quant-ph] (2004). 

[14] M. Christandl and G. Mitchison, Commun. Math. Phys. 

261, 789797 (2006). 
[15] S. Bravyi, Quant. Inf. and Comp. 4, 012 (2004). 
[16] W.-K. Tung, Group Theory in Physics (World Scientific 

Pubhshing Company, 1985). 
[17] F. G. S. L. B. ao, M. Horodccki, J. Opponhcim, J. M. 

Renes, and R. W. Spckkcns, arXiv:1111.3882 [quant-ph] 

(2011). 

[18] M. Horodecki and J. Oppenheim, arXiv:1111.3834 
[quant-ph] (2011). 

[19] In particular, the requirement of constant total entropy 
during the purification is particularly natural given the 
subtle cntropic counting that needs to be performed in 
any analysis of Szilard engines. 

[20] Heat is usually defined as = tr(pJ^_H'^) — tx{p^H^) 
(see for instance A. Peres Quantum Theory: Concepts 
and Methods, Springer (1995)) but it is assumed that the 
initial and final states are both diagonal in ff^. In the 
heat flow model this is true for the initial state, however 
for the flnal state [pj^, H^] 7^ is permitted. This is not 
fundamentally a problem when we remember that the 
only property being measured is the changes in the ob- 
servables Ha-, Hb, i.e. the changes in local energies, and 
this is called "heat" because the local entropies vary and 
the energies exchanged between A and B are assumed 



inaccessible for external work. In our model the exper- 
imenter is not required to know the initial correlations 
nor the interaction Hamiltonian so we need not appeal 
to a generalized notion of work and heat such as that 
proposed in H. Weimer, M. J. Henrich, F. Rempp, H. 
Schroder, and G. Mahler EPL 83 30008 (2008). 

[21] It is reasonable to assume that A and B are "locally ther- 
mal" , that is, when one is restricted to doing only local 
operations on them, they are indistinguishable from un- 
corrclatcd thermal states with matching local Hamiltoni- 
ans and temperatures. Although they are locally thermal 
they can still be correlated. 

[22] The state of minimal correlations pmin is not unique due 
to symmetries of the QMl which are local unitary oper- 
ations and a swap of A and B states. 

[23] Let the eigenvalues A; in spectrum A of the joint state p 
be arranged in non-increasing order Ai > A2 > A3 > A4 
and denote the two eigenvalues of the reduced state as 
Ap, 1 — Ap where < A^ < |, M G {A, B}. Then pA, pa 
are valid marginals of a state in O if and only if their 
eigenvalues satisfy the following inequalities: Aa > A3 -|- 
A4, As > A3 + A4, Xa + Xb>X2 + X3 + 2A4, I Aa - Asj < 
min{Ai — A3, A2 — A4}. These inequalities define the set TZ 
and this result is taken from S. Bravyi, Quant. Inf. and 
Comp. 4, 012 (2008) 



